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(57) Abstract 

A method and apparatus for controlling bit rates used in a moving pictures encoder, such as an MPEG standard encoder. A sequence 
of moving pictures is divided into segments each of which comprises one or more group of pictures. A constant overall bit rate is specified 
for the sequence of pictures, but variable bit rate encoding used within each segment. A difference between the number of bits allocated 
for encodinc the seement and the actual bits used for encoding is determined, and the difference distributed over one or more subsequent 
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MOVING PICTURES ENCODING WITH CONSTANT OVERALL BIT-RATE 

Field of the invenrion 

5 The present invention relates to a method and apparatus for encoding moving pictures. In 
particular, the present mvendon relates to a method and apparatus for performing variable 
bit rate control in a digital video encoder while maintaining a pardcular overall bit-rate. 

Background of the Invenrion 

10 

One of the main obstacles faced by industry dealing with digital video processing, storage 
and transmission is the large amount of data needed to r^resent analog video in the digital 
domain. Accordingly, digital compression is often applied to moving pictures to achieve a 
reduction in required transmission bandwidth or storage size. One variety of such 

15 conqjression techniques can be derived from the ISO/IEC MPEG Standards, the ISO/IEC 
11172-3 (MPEG-1), the ISO/IEC 13818-2 (MPEG-2) and the MPEG-2 TM5 (test model 
S), developed by the Moving Picture Experts Group of the International Organisation for 
Standardization. The disclosures of those standards documents are hereby expressly 
incorporated into this specification by refermce. MPEG-1 is the compression standard 

20 used in VideoCD while MPEG-2 is the video compression standard used in DVD and 
many digital broadcasting systems. 

The MPEG standards specify only the syntax of the compressed bitstreams and method of 
decoding. The method of implementation in die encoder is left to the developer, and any 
25 form of encoder may be en^)loyed as long as the resulting bitstream conforms with die 
specified syntax. 

In certain applications such as video storage device (recorder), it is possible to use variable 
bit rate (VBR) encoding. A VBR encoder is able to vary its output bit-rate over a larger 
30 range than a CBR encoder* and this would generate an output which has a more constant 
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visual quality. An example of a VBR encoder is described in United Slates patent number 
5,650,860, entitled "Adaptive Quantization" . In order to maintain a maximum bit rate 
allowed by the target storage device as well as an overall bit-rate which enables input 
picture sequence to be stored into a defined storage space, such VBR encoders udUse 
S multiple encoding passes. 

In the first encoding pass, the bit utilisation information is determined for each scene or 
each picture in the input sequence. This may be done by fixmg die reference quantisation 
step size and disabling tbe VBV control. The determined bit utilisation information is then 

10 used to generate a bit budget for each scene or picture such tiiat an overall target number 
of bits to code die sequence is fixed, and that the maximum bit rate is not violated. In 
cases that bit utilisation information obtained is not close to that required for generating 
±t bit budget, steps from die first coding pass must be repeated witii an adjusted reference 
quantisation step-size. Hie input sequence is coded in a final pass using the generated bit 

15 budget information to achieve die target bits or overall bit rate. 

Multiple-pass VBR encoders requires large storage memory for intermediate bit utilisation 
information, and large computation needs for die additional passes and bit budget 
generation. Funhermore, such a VBR encoder cannot process input sequences in real-time 

20 as required by certain applications. 
Summary of die Invention 

It is an object of die present invention to provide a single-pass real-time variable bit rate 
25 encoder for moving pictures. It is also an object of die present invention to provide 
variable bit rate encoding of moving p'cmres such diat die change in encoded picmre 
quality from one scene to anodier is minimised. A further object is to provide a real-time 
variable bit rate encoding algoridim which produces a constant overall bit rate. 



30 In particular, die present invention encodes an input moving picmres sequence 
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segment at a time according to a target encoding quality which is determined by a target 
segment bit rate. The target segment bit rate of a current segment is preferably derived 
from the differences between the target segment bit rates and the actiial coding bit rates of 
previous or previous few encoded segments. 

5 

To maintain consistent encoding quality for all picmres within a segment, the actual target 
bit rate for encodmg the picmies is made variable according to their scene complexities as 
well as the target encoding quaiiQr of the segment. 

10 As the target encoding quality of each segment is modified based on the differences 
between the target and the actual bit rates of previous or previous few encoded segments, 
the change of target encoding quality from segment to segment is made relatively smooth 
compared to that of a Constant Bit-Rate Encoder, and fuitheimore, the overall bit rate of 
encoding is maintained constanL 

15 

In accordance with the present invention, there is provided a method for use in a movmg 
picmres encoder for encoding a sequence of segments each having at least one image, 

coiiq)rising the steps of: 

a) determining an overall target bit rate for encoding the sequence of unages; 

20 b) determining a bit allocation and target quantisation step size for encoding a 

first segment on the basis of a segment target bit rate calculated using said overall 

target bit rate; 

c) encoding said first segment using a variable bit rate encoding method 
according to the target quantisation step size; 
25 d) determining a difference between the number of bits used to encode said 
first segment and said first segment bit allocation; 

e) distributing said difference for use m encoding at least one subsequent 
segment to determine a subsequent segment bit allocation; 
0 determining a new target quantisation step size for encoding a said 
30 subsequent segment on the basis of a new target segment bit rate calculated using 
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satd segment target bit rate and the distributed difference; and 

g) encoding said subsequent segment using a variabie bit rate encoding method 

according to the new target quantisation step size; 

wherein variable bit rate encoding is en^loyed for encoding picnjres within a 
5 s^ment whilst maintaining a substandally constant bit rate over said sequence. 

The present invention also provides a mediod for oicodir^ moving picmres in a moving 
picmies encoder wherein a sequence of images are provided as input, the sequence of 
images comprising a plurality of segments each having a pluraUty of images, the method 
10 including: 

a) determining an overall target bit rate for encoding tiw sequence of images; 

b) maintaining a distribution record of bits from at least one previously 
encoded segment allocated for use in encoding at least one segment to be encoded; 

c) determining a target segment bit rate for a segment of the sequence of 
15 images on the basis of die overaU target bit rate and a bit rate change calculated 

from the corresponding allocated bits from the distribution record; 

d) determining a target segment encoding quality from the target segment bit 
rate, a preceding target segment bit rate and a preceding target segment encoding 
quality,; and 

20 e) encoding the images of the segment according to the target segment 

encoding quality using a variable bit rate racoding technique taking into account 
scene complexities of the ims^es in the segment; 

wherein maintaining said distribution record includes determining a difference 
between the number of bits used to encode a particular segment and die number of bits 
25 allocated for encoding the particular segment on the basis of die target segment encoding 
quality. 



30 



According to die current invention, a moving pictures sequence is divided into segments. 
The size of each segment may be suitably deteraiined. Each segment is encoded widi a 
target encoding quality derived from its target segment bit rate. A variable bit rate (VBR) 
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encoder is utilised to encode the segnjent according to its target encoding quality. 

The target segment bit rate of an initial segment is obtained from a user defined target 
overall bit rate. After encoding the segment, the difference between the acmal bit rate 
5 used and the target segment bit rate is obtained. This difference is propagated to the next 
or next few segments to be coded. This process is repeated for each segment; therefore, 
for each subsequent segment, a new target segment bit rate is determined from the user 
defined target overall bit rate and the differences between the target segment bit rates and 
actual bit rates of previous or previous few segments. 

10 

The present invention fiirther provides a method for controlling bit aUocadon in a moving 
pictures encoder for encoding a sequence of images conq>rising a plurality of segments 
each having a phirality of images, the method including, for each segnient: 

determining a difference between a number of bits used for encoding a previous 
15 segment and a number of bits allocated for encoding the previous segment; 

calculating a bits distribution from the determined bits difference and a 
predetermined distribution function; 

calculating a bit rate change from the bits distribution and a predetermined number 

of images in the segment; 
20 calculating a target segment bit rate from the bit rate change and a predetermined 

target overall bit rate for the sequence of images; and 

determining a target segment encoding quaUty from the target segment bit rate. 

The present invention further provides an encoding quality adjustment processor for 
25 generating a target segment encoding quaUty value in a moving picmres encoder for 

encoding a series of segments each having at least one image using a variable bit rate 

encoding scheme whilst maintaining a substantially constant overall bit rate, comprising: 
a bits difference computation means coupled to receive a segment encoding bit 

utilisation value and a target segment bit rate and generate therefrom a bits difference 
30 value representing a difference in bits allocated and bits used for encoding a segment; 
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a bits distribution means coupled to the bits difference computation means for 
computing at least one bits distribution value from the bits difference value and a 
predetermined distribution function; 

a bit rate difference computation means coupled to the bits distribution means for 
5 computing a segment bit rate difference from the at least one bits distribution value and a 
predetermined number of images in a segment; 

a target segment bit rate adjustment means coi^led to the bit rate difference 
computation means and the bits difference computation means for computijag said target 
segment bit rate from die segment bit rate difference and a predetermined target overall bit 
10 rate for die sequence of segments; and 

an encoding quality computation means coupled to the target segment bit rate 
adjustment means for computing a target segment encoding quality value from said target 
s^ment bit rate. 

15 The present invention fiirtiier provides a moving pictures encoder comprising: 

a coding processor for encoding picmre data based, on macroblocks according to a 
quantisation step size; 

a virtual buffer processor coupled to the coding processor for tracking a number of 
bits used for encoding successive macroblocks in a picture and a number of bits used for 
20 oicoding successive pictures in a group of pictures; 

a quantisation step size processor coupled to die coding processor for determining 
said quantisation step size from a target number bits allocated for a picmre and the number 
of bits already used for encoding macroblocks in that picture; 

a picmre bit allocation processor coupled to die quantisation step size processor for 
25 detemuning said target number of bits allocated for a picmre from a target bit rate and die 
number of bits already used for encoding picmres in a current group of picmres; 

a bit rate adjustment processor coupled to die picture bit allocation processor, the 
virmal buffer processor and die quantisation step size processor for determinir^ said target 
bit rate from die number of bits already used for encoding successive picmres in die 
30 current group of picmres, a target encoding quantisation step size and an average 
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quantisadon step size for pictures in the current group of pictures; and 

a target encoding quantisation step size processor coupled to the bit rate adjustment 
processor and die virtual buffer processor for determining said target encoding 
quantisation step size from a ptedetennined target overall bit rate and die number of bits 
S used for encoding a preceding group of pictures. 

Brief Description of the Dravyings 

The invention is described in greater detail hereinafter, by way of example only, witii 
10 reference to die accompanying drawings, wherein: 

Figure 1 is a block diagram of die constant bit-rate controller ba^d on TM5; 
Figure 2 illustrates die difference between a target bit aUocation and an actual bits 
consumption at macroblock level for one firame (a P-picmre is chosen for diis case), where 
d, is die virtual buffer fuUness at aparticular instance; 
15 Figure 3 is a block diagram of die variable bi^rate encoder widi constant overall 

bit-rate control; 

Figure 4 is a block diagram of die constant overall bit-rate controller; 
Figure 5 illustrates how die difference ui bit count for the last segment is 
redistributed over die next four segments (e.g. f(m)=l/4); and 
20 Figure 6 is a flow chart of a VBR algoridsm widi constant overall bit-rate control. 

Detailed Description of the Preferred Embodiments 

In a standard MPEG compUant video encoder, a sequence of moving picmres (e.g. video) 
25 is input to die encoder where it is compressed widi a user defined target bitrate. The 
target bitrate is set accorduig to die communication channel bandwiddi in which die 
compressed video is to be transmitted, or die storage media capacity in which die 
compressed video sequence is to be stored. A typical MPEG encoder involves motion 
estimation/prediction, Inter/lntra classification, discrete cosine transform (DCT) 
30 computation, quantisation, zig-zag scanning, variable lengdi coding and rate-control. 
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Several different forms of coding can bs employed depending upon the character of the 
input pictures, referred to as I-pictures, P-picmres, or B-picmres. The Ii)icnires are intra- 
coded pictures used mainly for random access or scene update. The P-picmres use 
forward motion predictive coding with reference to previously coded I- or P- picmres 
5 (anchor picmres), and the B-picmres use both forward and backward motion 
predictive/interpolative coding with reference to previously coded I-or P-picmres. 
Furthermore, a group of picmres (GOP) is formed in encoded order starting witfi an I- 
picmre and ending witfi the picmre before the next I-picmre in the sequence. 

10 The picmres are partitioned into smaller and non-overlapping blocks of pixel data called 
macroblocks (MBs) before encoding. Each MB from a P- or B-picmre is subjected to a 
motion estimation process in which forward motion vectors, and backward motion vectors 
in the case of a B-picture MB, are determined using reference pictures firom a frame 
buffer. The target macroblock in the current picture is matched witii a set of displaced 

15 macroblocks in the reference picmre, tiie macroblock that best matches the target 
macroblock is used as the predicted macroblock. The position of tiiis predicted 
macroblock is specified by a set of vectors known as motion vectors, which describe tiie 
vertical and horizontal displacemem between the target and predicted macroblock. For a 
B-picture. the process is simUar except tiiere are two reference pictures: anchor picmres 

20 immediately preceding and following the B-picture. 

With the determined motion vectors, motion compensation is performed where die inira-or 
inter-picmre prediction mode of tiie MB is first determined according to the accuracy of 
tiie motion vectors found, followed by generating tiie necessary predicted MB. I-picmres 
25 are always intra coded while for P and B-picwres, a decision on whedier intra or inter 
coding will be used (at macroblock level) is made depending on which metiiod will give 
rise to a more efficient coding. 

Transformation of tiie macroblock using a DCTT is tiien carried out on die 8x8 pixel blocks 
30 witiiin tiie macroblock. For intra coding, tiie actual picmre data is coded, while for inter 
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coding the prediction error is coded. This is followed by a quantisation process of the 
DCT coefficients which involves a qua^itisation ntiatrix and a quantisarion step size. The 
quantized coefficients are then mn-length encoded with variable length codes. 

5 The resultant bit usage and statistical data are passed onto a rate control module, which is 
used for allocating a target number of bits used to encode each picture and each 
macroblock within the picture. This is an important module in die encoder as it plays a 
major role in maintaining die quality of die encoded picture. 

10 The rate control in MPEG-2 Test Model 5 (TM5) comprises the steps of allocating the 
target amount of bits for coding each picmre, deriving die reference quantisation 
parameter (Q/) to be used on each macroblock in a picture, and modulating the (2y based on 
the activity masking level of die surrounding blocks of the corresponding macroblock to 
obtain die modulated quantisation st^ size (Mquant) used to quantise die macroblock. 

15 

An objective of diis rate controller is to ensure all pictures maintain a similar level of 
quality. It assumes that die subjective quality of a single coded picture can be quaUfied 
vwtii a single number V, described by factor K/Q where K isz constant particular to a 
picmre type and Q is die quantisarion step size for die picmre being coded. That is, die 
20 rate controller will try to preserve die following equation: 

The subscripts i, p, b refers to I, P, and B-picmre types. The parameters K„ K^, and 
are experimentally determined constants for all I, P, and B pictures respectively, and K, 
usually is normalised to die value of 1. 

25 Figure I illustrates a block diagram of a known embodiment of die TM5 rate controller. 
A group-of-pictures (GOP) is a collection of one I picture, some P pictures and B pictures, 
and serves as a basic access unit widi die I picmre as die entry point to facilitate random 
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access. The controiler comprises three levels of processing: a GOP level 111. apicture 
level 110, and a macroblock (MB) level 109. At the stan of every new GOP at the GOP 
level 111, a GOP bit allocation process 100 computes the total number of bits (/?^ 
allocated for the GOP. The value of is given by: 



bit rate x N 
picture_rate 



(I) 



5 where bit_rate is the target bit rate for encoding the picmre sequence, 

piaurejate is the number of pictures coded per second, and 
N is the total number of pictures coded in the GOP. 

The remaining bits (/?) for the GOP is determined ai the picture level 110 by a remaining 
ID bits determination process 106. The value of R is updated as: 



R=R+R, 



^gCp 



where S is the number of bits used by previously coded 
picmres in the GOP, and 
for a new GOP. 



15 



With the computed value of i?, a picture bit allocation process 101 at the picmre level 110 
then computes a target bit value (7) allocated to the current picture according to the 
equations below for corresponding I, P or B picture type: 

R bitjate 



= max 



^ N^p iVjA; ' K X picture jate 



(2) 



T = max 
p 



R 



bit rate 



^ ^b^/b ' K X picture _rate 



(3) 
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« max 



bit rate 



N„KJC„ ' K X picture jeae 



(4) 



where 



T„ Tp. Represents target bits for the next picture (I,P3) 
iVj, Np Represents the remaining number of pictures (P,B) in the GOP 
5 X„Xp,Xi Rq)tesenis global complexity measures and gives a measure of the 

actual number of bits required to represent the picture (without 
conq>ression), and 

10 3^ = i2,x5, 

5;, Spf S» are the actual number of bits used to code the previous I/P/B 
frame. 

IS K is a constant (e.g. 8) 



After computing the target bits for the picture, a reference quantisation step-size {Qj) 
computation 102 is carried out at the MB level 109 for each macroblock within the 
picnire. The value of Qj is computed based on the determined target bit allocation (7,, Tp, 
20 or Ti) and a buffer fullness value (dj). Each of the three picture types has a virmal buffer 
associated widi it and these buffers are updated after coding each macro block of the 
picture type according to the following equations: 

...... «,.ZIlM (5) 

^ " ' ' MB Cnt 
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^1 «o Cnt 



(6) 



4* = ^o' * Bj-r 



T, X (7 -1) 
MB Cnt 



(7) 



where is the initial virtual buffer fullness, 

dj is the virtual buffer fullness when coding the/* MB, 
B^, is the actual bits consumed up to and including Q-Vf MB as provided 
5 by a virtual buffer update process 105, and 

MBjCnt is the number of MBs in the picture. 

Equations (5) to (7) effectively track the differences between the actual number of bits 
used and the target bits aUocated, and these differences are then added to the respective 
10 virtual buffers which are used to compute Q,. This aUows the rate controUer to control the 
bits allocarion based on the consumption pattern of the picture. Q, is computed from the 
buffer fullness via the equation: 

Qj^ {d, X 31) / r « dfy X constant 
1 5 where r is a reaction parameter = 2 x bitjate I picture j-ate 

The reaction parameter, as the name implies, is a factor that can control the sensitivity of 
the algorithm from a change in d, Large r will cause the reaction to be slower, which 
may cause tiie target bits and acmal bits to differ significantly, but it brings about a more 
20 gradual rate of change in bit consumption which is favourable for scene changes. Ontiie 

other hand, a small r causes the controller to be more reactive to changes, giving rise to a 
closer target and acmal bits value, but a faster response also means a less gradual change 
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during scene change which is not desirable. A graph illustrating the difference between 
the target bit allocation and die actual bits allocated within a frame is shown in Figure 2. 

The value of (2y is turdier modified by an activity masking process 103 to give the 
5 modulated quantisation step size. M^Hont. Basically, the spatial masking ability of die 
macroblock is used to plxe a correction factor onto die computed Qj value. Spatial 
masking ability is the ability to contain noise masked from human visual systems. 
Typically, an area with complex texture will have a larger correction factor tfian an area 
with simple texture, hence, 

10 

(O) 

Mqitara = Njtctj x Qy 

where N_actj is the normaUsed value of macroblock activity level and may have a 
value of betwem 0.3 and 2 

15 

With the computed Mquant, the macroblock coding process 104 is performed where die 
macro block is compressed according to die MPEG standards. 

20 At the end of coding a picture, die bit count S used for coding die picture is used to 

perform a VBV check 107 and to compute die remaining bits R for die current GOP at die 
remaining bits determination process 106. The VBV (video buffer verifier) is a virtual 
buffer emulating die stams of die decoding buffer. Tlie VBV check (107) is performed to 
detect any overflow or underflow of die decoding buffer widi reference to die target bit 

25 rate. 

When coding a picture sequence widi varying scene complexity, a constant bit rate (CBR) 
encoder is unable to vary the bit-rate according to die scene complexity. This results in 
scenarios whereby simple scenes are allocated more bits dian required while complex 
30 scenes are allocated insufficient bits, and dierefore results in a variation of output visual 
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quality between scenes of different connpiexities. 

An embodiment of a moving pictures encoding apparanis according to the present 
invention is iUustraied in block diagram form in Figure 3. The encoding apparatus as 
5 illustrated is arranged in four levels corresponding to processing stages in the bit rate 
control process, namely a segment level 313. a GOP level 312, a picmre level 311 and a 
macroblock (MB) level 310. An input moving pictures sequence is encoded in such a way 
that on the average, or at the end of encoding, the output bit rate is close to a user 
definable target overall bit rate (overall JF) 320. The input sequence is divided into 
10 segments and groups of pictures (GOP). The purpose of a segmem is for monitoring of 
output bit rate with reference to the overall JR, and the purpose of the GOP is primarily 
to facilitate random access. A segment may be defined to include a number of GOP(s) 
depending on die need in terms of frequency of monitoring output bit rate. Each GOP 
comprises at least an I-picmre and optionally one or more P-picmres and/or B-picmres. 
15 Each picmre is divided into macroblocks of pixels for encoding. Hence, a method of rate 
control according to the current inventioii may contain processes at the segment level 313. 
GOP level 312, picture level 311, and finally macroblock level 310. 

With a new group of picmres, a GOP bit allocation processor 300 computes the number of 
20 bits allocated to the current GOP (/?'^ as follows: 



**** picturejate 



where: 

Ng^ is the number of pictures in the GOP, 
picturejate is the number of pictures coded per second, and 
25 BR is a target bit rate. 

The target bit rate BR is determined for each picmre or plurality of picmres by a bit rate 
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adjustment processor 306 which is described hereinbelow. A remaining number of bits 
(/?•) for the GOP is determined at the picmre level 311 by a remaining bits determination 
processor 308, which carries out die steps of: 

5 (a) before encoding the first picmre in a GOP, adjusting/?' with a new 

R' += R'^, and dien set BR^ = BR 

(b) otherwise if die picmre to be coded is not the first picmre of a GOP, and a new 
10 target bit rate BR is determined, tiien adjusting R' with die new BR according to: 

R! a X (BR - BR^, and then set BR^ = BR 

picturej'ote 

where N is remaining number of picmres in die currem GOP 

(c) and removing number of bits used by die last coded picture S from die remaining 
bits value hence: 



15 



R'^R'-S 



The computed R' is dien passed to a picmre bit aUocarion processor 301 to compute die 
target bit (7) allocated to a current picmre to be coded. For example, equations (2), (3) 
20 and (4) described hereinabove may be used for diat purpose, widi die parameters K,, K„ 
N,. and pictjype being supplied. Note diat die lower limit of bU_rateKi*piaurejate) 
is only optional and may be adjusted if necessary. 

At die macroblock (MB) level 310. a reference quantisation step-size computation 
25 processor 302 computes a reference quantisation step-size Qj for each MB using die 
computed target bit allocation T and a bit utilisation parameter B determined by a virwal 
buffer update processor 305. An example of a mediod for computing (2/ for die/ MB of 
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the current picture is represented by: 



K, X D.x picturejrate 

0 = — i — (11) 

^> K^xBR 



where and JCi are constants (eg. 31 and 2 respectively). 
BR is the deannined target bit rate, 
picturejate is the number of coded picnires per second, and 
5 Pj is a virtual buffer fullness 

The virmal buffer fullness of the/* MB is determined by: 

D ' D^* B — =- (12) 

' ° MBSnt 

where £>o is an initial buffer fiiUness before coding die current picmre, ie. Dj at end of the 
previous picture, 

10 is the bit utilisation information suppUed by die virtual buffer update processor 

305, ie. bits used to code the 1* MB to (/-^* MB, 
MB Otf is die total number of MB in die current picmre, and 

K-i is a constant (eg. 1). 

15 Three independent current and initial virmal buffers fulhiess vahies {Dj, Df, £>/, Do , D/. 
Do*) may be maintained for die diree picture types (I-pictures, P-picmres, and B-picmres). 
The computed may also be further scaled by an activity masking processor 303 
according to a masking factor determined by die surrounding activity levels of die MB to 
form tfu5 final quantisation step-size, Mquant, for coding die current MB. A mediod of 

20 masking factor determination can be found in die aforementioned MPEG-2 TM5. 

Macroblock coding (304) is dien performed to encode the current MB. A macroblock 
coding processor 304 may employ, for example, mediods xcording to the MPEG-1 or 
MPEG-2 video encoding standards. Such encoding mediods include necessary motion 
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compensaiion. discrete cosine transform, quantisation with the determined quantisation 
step-size. and run-length encoding wiu variable length codes. The methods also include 
necessary decoding processes such tfiat motion compensation can be performed. The 
number of bits utilised by die macroblock coding processor 304 to code each MB is passed 
5 to die virtual buffer update processor 305. 

In applications where a maximum and/or minimum bit rate must be maintamed for 
encoding, a VBV checking processor 307 is utilised. User definable maximum and/or 
nunimum bit rates {nuvUnm BF) are input at 321 to die VBV checker 307, a metiiod of 
10 VBV checking according to die MPEG standards is used to examine bit utiUsation 
information from die virmai buffer 305, and necessary corrections are made to ensure 
compliance and diat die output bit rate is widiin die defined max/min BR. 

At die end of coding a picture or a pluraUty of pictures, bit rate adjusmient is applied by 
15 die bit rate adjusmient processor 306 to provide any necessary correction to die current 
target bit rate BR. The correction is based on a target encoding quaUty provided by a 
target segment quality adjusmient processor 309 and a resultant encoding quality of 
previously coded picmre(s) such tiiat die overall enco<Ung quaUties of pictures witiiin a 
segment are relatively close to die target constant The resultant encoding quality may be 
20 determined by die average value of die reference quantisation step size (ie. average J2P ot 
die previously coded picture(s). A mediod of target bit rate (5/!) determination can be 
derived from a rate-quantisation model as given by: 

X (avera ge_Qf - target_0) 
BR » current JR * > 

where current JBR is a current estimated bit rate, or 
current B/? = Sj + /V, x + N» x S», 
25 S, S,. I are bits used by previously coded I, P. and B-pictures respectively. 

Np, N, are total number of P and B-picmres in die current GOP, 
average_Qj is the average value of C2, of previously coded picture(s) 
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target Qj is the target encoding quality or target value of Qj, 

may be a constant, or a txtor of previous BR, maxJR, or current JR, and 
may also be separately determined for I, P, and B-picmre types. 

5 Maximum and/or minimum bit rates can be appUed to the determined BR according to 
application requirements. The max/min BR input at 322 are used as given by: 

if {BR > maxJBR), then BR = max_BR 
if (BR < mm_BR), then BR = mm_BR. 

10 

It is also possible to make use of the target jQj at the macro-block level to increase 
. efficiency of encoding. Basically, the fflrg«_(2y is used by the reference quanrisadon step- 
size computation processor 302 as a lower limit of the output reference quantisation step- 
size Qj such that when this target (quaUty) is reached at the MB level, bits are saved for 
1 5 future encoding immediately. In this case, the output reference quantisation step size may 
be set acconting to: 

if (Qy < target Ji), then Qj = target J2j. 

20 The target bit rate BR is adjusted continuously with reference to a fixed target encoding 
quality within exh segment. In turn at the beginning of each segment, the target 
encoding quaUty is adjusted so tiiat a target overaU bit rate is achieved. A segment may 
contain a few groups of pictures depending on the need in terms of frequency of 
monitoring output bit rate. A new segment may also be defmed by a scene change 

25 detectable by any conventional scene change detector with a given range of time. 

At the onset of a new segment, the target segment quality adjustment processor 309 
executes a check on die overall bit-rate based on bits usage and makes any necessary 
adjustments to the target encoding quality for the bit rate adjusm^eni processor 306 so that 
30 the overall bit-rate converges to a user definable target overall bit-rate 320 (overall JR). 
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An example embodiment of a constant overaU bit rate controller implementing the target 
segment quaUty adjustment process according to the present invention is illustrated in 
block diagram foim in Figure 4. The bit count difference between the actual and target bit 
counts {bits Jiff) for coding of a previous segment is calculated by a bits difference 
5 computationprocessor 401, utilising the steps of: 

a) obtaining the actual bits (bitsjegment) used for coding the previous segment 
according to the input bit utilisation of pictures (S) 400 in the previous segment, 
and 

10 

b) computing the value of ttojffjf based on a corresponding target segmeni bit rate 
406 (segment^BR) for the previous segment, according to: 

ito Off , f ^ ^se^ . bitsjegment (14) 

"* picture _rate 

where AT,,, ,,Js the number of coded pictures in the previous segment. 



15 The bit count difference (pUsjm is then redistributed by a bit difference distribution 
processor 402 over the next k number of segments using a bit distribution function, j{m), 
expressed as: 

deUaJits„ = J{m) x bitsjUff 

20 

where m = 1,...,*, 
S'/m) = 1, 

delta bits„ is the bits difference distributed to next m* segment. 

25 For an example case of jfc=4 andy(m)= 1/*, Figure 5 illustrates how the bit count 

difference {bitsjiffi of an encoded segment is distributed over the next 4 segments. The 
period of* segments used for bits compensation is referred to as an adjusunent interval. 
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A delta bit-rate computation processor 403 (Figure 4) accumulates all bit differences 
(delta Jits) distributed from previously encoded segments to the current segment to be 
coded, and computes a delta segment bit-rate iAsegmentJR) based on the accumulated 
delta bits and the number of pictures in the current segment to be coded. The delta 
5 segmLit bit-r3te and a user definable target overall bit-rate {overall_BR) input at 408 are 
used by the target segment BR adjusmient processor 405 to derive the target segment bit 
rate (segment JR) 406 for the current segment. The value of segment JR can be 
expressed as: 



10 segment JR =■ overcUlJSR + Lsegment_BR 



(16) 



A new target encoding quahty (target_Q) 407 for encoding of the current segment is then 
determined from the target segment bit rate using a BR-Qj modelling processor 404. The 
BR-<^ modelling processor may operate, for example, according to: 



LQ^ = target_Q, x ——^ 



target_Qj = tcarget_Qj + AQ^ 



(17) 



(18) 



1 5 where target JQ) is the target Qj of the previous segment, 

segment JR' is the target segment bit rate of the previous segment, and 
K, is a constant which can be experimentally determined. 

A maximum limit may be placed on the determined Afi; so diat there is no drastic change 
20 in output quality from one segment to another. 

A tlow chart for a process of variable bit rate (VBR) encoding with constant overall bit- 
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rate control according to an embodiment of the invention is illustrated in Figure 6. 
Initialisation of predetermined parameters is first carried out at step 600. Then, at step 
601 the process determines whether processing is at the start of a new group-of-pictures 
(GOP) or not. Where a new GOP is determined, step 602 is carried out by updating the 
5 bit aUocation for the new GOP. This may involve, for example, computation of the GOP 
bit allocation R'„ according to Equation (10) described hereinabove and accumulating to 
the remaining bit value R' to give the i?' for the new GOP. 



For each picture in the current GOP, a target bit aUocation value T is determined at step 
10 603, and this may be computed according to Equations (2), (3) and (4), for example. 
Then, for each macroblock in the picture, a reference quantisation step size is 
determined using the computed target bit aUocation T, such as by the process represented 
by Equations (11) and (12). Activity masking may also be inchided in this step. The 
macroblock of the picture is then encoded at step 605 using the computed quantisation step 
15 size, and steps 604 and 605 are repealed for aU of the macroblocks in the picture untU the 
end of the picture is determined at step 606. 

When the end of the sequence of moving picmres which is being encoded is reached, this 
is determined at step 607, which terminates the process at step 611 upon that occurrence. 
20 Otherwise, the process continues to step 608 where it is determined whether the end of the 
currmt segment of pictures has been reached. 

When the end of a segment of pictures is reached and processing of a new segment about 
to begin, the target encoding quaUty is adjusted at step 609. This is performed by firstly 

25 computing the difference between the number of bits aUocated for coding the previous 
segment and the acmal number of bits used in coding that segment, such as by the process 
represented by Equation (14). This quantity, bitsJW^ represents extra bits which are left 
over from the previous segment of pictures, and may be distributed for use in encoding the 
ensuing picture segments. The left over bits bitsjiffzia distributed for use over one or 

30 more segments according to a bit distribution hinction, an example of which is described 
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in 
are 



connection with Equation (15). In essence, the left over bits from the previous segment 
_ divided into a pluraUty of k, preferably equal, amounts and allocated to the following k 
segments for encodmg with. The dividends allocated from all of the k previously 
processed segments are accumulated and used to determine a change in segment bit rate, 
5 AsegmemJR, according to the accumulated bits difference and the number of picmres in 
the segment to be coded. This can then be used to compute an allocated bit rate for the 
segment to be coded according to Equation (16). Fmally. a target encoding quaUty, 
targetjQj, can be computed according to Equations (17) and (18), for example. 

10 If the end of a segment has not been reached at step 608, or after the target quality 
adjusmient of step 609, the target quality and the acmal quality of encoded picmres is 
compared, and a new bit rate for encoding the next picmre is computed based on the 
difference. This step can be carried out as described in relation to Equation (13), for 
example. The procedure then rewms to step 601, described above. 

15 

In summary, embodiments of the present invention provide methods and apparatiis for 
encoding moving picmres with a variable bit rate whilst maintaining a consistent ouliput 
encoding quaUty according to a detemiined target quality. The target quality is adjusted at 
the beginning of every moving picmres segment according to a bit distribution function to 
20 ensure an overaU bit rate that meets a defined target. Furthermore, tiie segment based bit 
distribution ftmction provides smooth and flexible modulation of die encoding quaUty. 
The method can be implemented at low cost and with the abiUty to encode an input 
moving picmres sequence in one-pass at real-time. 

25 It will be readily apparem to tiiose of ordinary skill in the art diat the foregoing detailed 
description of die presem invention has been presented by way of example only, and is not 
intended to be considered limiting to die invention as defined in die claims appended 
hereto. In particular, it is envisaged diat numerous variations to die embodiments as 
described can be made without departing from die spirit and scope of die invention. 

30 
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Throughout this specification and the claims which follow, unless the context requires 
otherwise, the word "comprise", and variations such as "comprises" and "comprising", 
will be understood to imply the inclusion of a stated integer or step or group of integers 
steps but not the exclusion of any other integer or step or group of integers or steps. 
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Glossary: 



VBV video buffer verifier 

VBR variable bit rate 

5 CBR constant bit rate 

MPEG Moving Picture Experts Group 

DCT discrete cosine transform 

GOP group of pictures 

MB macroblock 

10 Q quanrisarion parameter (picture quality) 

Qj quandsation parameter for macroblock ^ 

Qi, Qbf Qp quantisation parameters for I. B and P type pictures 

J? number of bits allocated for encoding a group of pictures 

bit rate target bit rate for a picture sequence 

15 picture jate number of picttires coded per second 

iV total number of pictures in the group of pictures 

remaining number of P,B pictures in the group of pictures 

R, R • remaining number of bits for encoding a group of pictures 

5 number of bits already used in coding a group of pictures 

20 r„ Tp, T„ target number of bits for coding next 1, P. B type picmre 

X,, Xp, global complexity measures for I, P, B type picture 

dj, Dj virtual buffer fullness when coding the f macroblock 

dg. Do initial virtual buffer fulhsess 

B actual bits used up to and including (/-I)* macroblock 

25 MB Cnt number of macroblocks in the picmre 

r reaction parameter ( = 2 x bit_rate / picture jate) 

N act normalised macroblock activity level 

Mquant modulated quantisation step size ( = Njictj x Q,) 
overall_BR definable target overall bit rate 

30 BR target bit rate 
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B bit uulisaiion information (eg. bits used to code previous MBs in picture) 

current_BR current estimated bit rau 

avemge Qj average value of quantisation parameter for previously coded pictures 

target_Qj quanrisadon parameter value for target encoding quality 

S max BR maximum permitted bit rate 

min BR minimum permitted bit rate 

bitsjiff difference between actual and target bits used in coding previous segment 

segment JSR target segment bit rate 

bits segment acmal number of bits used in coding previous segment 

Kegmmi Humber of coded picmres in previous segment 

delta bits„ number of difference bits available to next m* segment 
J{m) bits distribution fimcdon 

Asegment_BR available difference in segment bit rate 



10 N, 
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Claims: 

1. A method for use in a moving pictures encoder for encoding a sequence of 
segments each having at least one image, comprising the steps of: 
5 a) determining an overall target bit rate for encoding the sequence of images; 

b) determining a bit allocation and target quantisation step size for encoding a 
first segment on the basis of a segment target bit rate calculated using said overall 
target bit rate; 

c) encoding said first segment using a variable bit rate encoding method 
10 according to the target quantisation step size; 

d) determining a difference between the number of bits used to encode said 
first segment and said first segment bit allocation; 

e) distributing said difference for use in encoding at least one subsequent 
segment to determine a subsequent segment bit allocation; 

1 5 f) deteraiining a new target quantisation step size for encoding a said 

subsequent segment on die basis of a new target segment bit rate calculated using 
said segment target bit rate and the distributed difference; and 
g) encoding said subsequent segment using a variable bit rate encoding method 
according to the new target quantisation step size; 

20 wherein variable bit rate encoding is employed for encoding pictures within a 

segment whilst maintaining a substantially constant bit rate over said sequence. 

2. A method as claimed in claim 1, wherein the steps d) tog) are carried out 
iteratively using die number of bits used to encode die subsequent segment and die 

25 subsequent segment bit allocation for determining said difference. 

3. A mediod as claimed in claim I or 2, wherein each segment comprises at least one 
group of picmres having an I-picture and optionally at least one P and/or B-picture. 

30 4. A medrod as claimed in claim 2 or 3. wherein die difference between die number 
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of bits used to encode the first segment and said first segment bit allocation is determined 
according to: 

overall BR x A^,«^, . 

bits diff = = - bitsjegment 

~ picture j-ate 

where: 

bits diff is said difference, 
5 overall^BR is the overall target bit rate, 

N is the number of coded images in die first segment, and 

bitsjegment is die actual number of bits used to encode the first segment. 

5. A mediod as claimed in claim 4, wherein said difference is distributed according 
10 to: 

deUa_bits„ = J{m) x bitsjiiff 
where delta Jits„ is die bits difference distributed to next m* segment in die sequence. 

A: is a positive integer, and 
1 5 fijn) is a bit distribution fiinction, where S^/C") = 1 • 

(. A method as claimed in claim 5, where /m) = Vk, 

7. A mediod as claimed in claim 5 or 6, wherein die steps d) to g) are carried out 
20 iteraiively using die number of bits used to encode die subsequent segment and die 

subsequent segment bit allocation for determining said difference. 

8. A mediod as claimed in claim 7, wherein die new target quantisation step size is 
calculated according to: 

^, (segment B R - segment _BR) 

AO = target_0' x ^-S — , pp. 

- * — K X segment_BR 

25 
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target_Q - target_Q * 

where target JQ is tfie new target quantisation step size, 
segmentJSR is tiie new target bit rate, 

target jQ' is tlie target quantisation step size of the preceding segment, 
segment_BR' is the target segment bit rate of the preceding segment, and 
S Kisa. constaiu. 

9. A method as claimed in claim 7 or 8, wherein for each subsequent segment the 
difference between the number of bits used to encode the segment and the segment bit 
allocation is determined according to: 

tits diff = " - bitsjegment 

" picture j-ate 

10 where: 

bitsjiiff is said difference, 

segment_BR is the segment target bit rate, 

A/ is the number of coded images in the segment, and 

'■^ segfitent 

bUsjsegmem is the actual number of bits used to encode the segment. 

15 

10. A method as claimed in claim 9, wherein said difference is distributed according 
to: 

deUaJits„ «)(m) x bitsjiiff 
where delta_bits„ is the bits difference distributed to next m* segment in the sequence, 

20 m = l,...,k, 

k is a positive integer, and 

f{m) is a bit distribution function, where S^y^m) = I. 



11. A method as claimed in claim 10, where )(/n) = I/*- 

25 
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12. A method for encoding moving pictures in a moving pictures encoder wherein a 
sequence of images are provided as input, the sequence of images comprising a plurality 
of segments each having a plurality of images, the method including: 

a) determining an overaU target bit rate for encoding the sequence of images; 
5 b) maintaining a distribution record of bits from at least one previously 

encoded segment aUocated for use in encoding at least one segment to be encoded; 
c) determining a target segment bit rate for a segment of the sequence of 
images on the basis of the overall target bit rate and a bit rate change calculated 
from die cone^nding allocated bits from the distribution record; 
[Q d) determining a target segment encoding quaUty from the target segment bit 

rate, a preceding target segment bit rate and a preceding target segment encoding 
quality,; and 

e) encoding the images of the segment according to the target segment 
encoding quality using a variable bit rate encoding technique taking into account 
15 scene conq)lexities of the images in die segment; 

wherein maintaining said distribution record includes determining a difference 
between the number of bits used to encode a particular segment and the number of bits 
allocated for encoding the particular segment on the basis of the target segment encoding 
quality. 

20 

13. A mediod as claimed in claim 12, wherein steps b) to e) are carried out iteratively 
for said sequence of segments. 

14. A method as claimed in claim 13, wherein each segment comprises at least one 
25 group of pictures having an I-picture and optionally at least one P and/or B-picture. 



15. A method as claimed in claim 12, 13 or 14. wherein the target segment encoding 
quality is calculated according to: 
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target^ = tarfset_Q * 

where target J2 is the target segment encoding quality* 
5egmem_BR is the target segnient bit rate, 
target jQ' is the preceding target segment encoding quality, 
segment _BR' is the preceding target segment bit rate, and 
S is a constant. 

16. A method as claimed in claim 15. wherein the difference between the number of 
bits used to encode a particular segmem and the number of bits allocated for encoding the 
particular segment is determined accordii^ to: 

bits <m = ^^^^"^ ' bitsjegment 
~ picture jrate 

10 where: 

bitsjtiff is said difference, 

segmentJBR is the segment target bit rate, 

N isthenumberof coded images in the segment, and 

bitsjegment is the acmal number of bits used to encode the segment. 

15 

17. A method as claimed in claim 16, wherein the allocation of bits in the distribution 

record is calculated accortUng to: 

delta Jits„ ^f{m) x bits Jiff 
where deUa_bits„ is the bits difference allocated to next m* segment in die sequence, 

20 m = 1 k, 

A: is a positive integer, and 

j{,m) is a bit distribution function, where = I. 

18. A metiiod as claimed in claim 17. where /m) « I/*- 

25 
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19. A method for controlling bit allocation in a moving pictures encoder for encoding a 
sequence of images comprising a plurality of segments each having a plurality of images, 
the method including, for each segment: 

determining a difference between a number of bits used for encoding a previous 
5 segment and a number of bits allocated for encoding the previous segment; 

calculating a bits distribution from die determined bits difference and a 
predetermined distribution function; 

calculating a bit rate change from the bits distribution and a predetermined number 

of images in the segment; 
10 calculating a target segment bit rate from die bit rate change and a predetermined 

target overall bit rate for die secpience of unages; and 

,j?t.^rmining a target segment encoding quality from die target segmem bit rate. 

20. A mediod as claimed in claim 19, wherein die difference between die number of 
15 bits used for encoding die previous segment and die number of bits aUocated for encoding 
die previous segment is determined according to: 

bits diff = ' . bitsjegmertt 

" picturejrate 

where: 

bits diff is said difference, 
segmera^BR is the previous segment target bit rate, 
70 A/ is the number of coded images in the previous segment, and 

bitsjegment is die actual number of bits used to encode die previous segment. 

21. A mediod as claimed in claim 20, wherein die bits distribution is calculated 
according to: 

25 deltaj)its„ = J{m) x bits Jiff 

where deUaJits^ is die number of bits difference allocated to next m* segment in die 
sequence, 
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k isi poadve integer, and 

J{m) is a bit distribution function, where = 1. 

5 22. A method as claimed in claim 21, where y(m) = 1/*. 

23. A method as clahned in any one of claims 19 to 22. wherein the target segment 
encoding quality is calculated according to: 

^. (segment BR - segment_BR) 
LQ = target^ x ^ ^ segment BR 

target _Q = target J2^ + 



where target J2 is the target segment encoding quality, 
1 0 segment _BR is the target segment bit rate, 

target J2' is the previous segmem target segment encoding quaUty. 
segment JR' is the previous segment target segment bit rate, and 
^ is a constant. 

15 24. An encoding quaUty adjuswiem processor for generating a target segment encoding 
quality value in a moving picmres encoder for encoding a series of segments each having 
at least one image using a variable bit rate encoding scheme whUst maintaining a 
substantially constant overall bit rate, comprising: 

a bits difference computation means coupled to receive a segmem encoding bit 
20 utilisation value and a target segment bit rate and generate tiierefrom a bits difference 
value representing a difference in bits allocated and bits used for encoding a segment; 

a bits distribution means coupled to tiie bits difference computation means tor 
computing at least one bits distribution value from die bits difference value and a 
predetermined distribution function; 
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a bit rate difference computation means coupled to the bits distribution means for 
computing a segment bit rate difference from the at least one bits distribution value and a 
predetermined number of images in a segment; 

a target segment bit rate adjustment means coupled to the bit rate difference 
5 computation means and the bits difference computation means for computing said target 
segment bit rate from the segment bit rate difference and a predetermined target overall bit 
rate for the sequence of segments; and 

an encoding quaUty computation means coupled to the target segment bit rate 
adjusmient means for computing a target segment encoding quality value from said target 
10 segment bit rate, 

25. A moving pictures encoder comprising: 

a coding processor for encoding picture data based on macroblocks according to a 

quantisation step size; 

15 a virmal buffer processor coupled to the coding processor for tracking a mmiber of 

bits used for encoding successive macroblocks in a picture and a mmiber of bits used for 
encoding successive pictures in a group of picmres; 

a quannsarion step size processor coupled to the coding processor for determining 
said quantisation step size from a target number bits allocated for a picture and the mimber 
20 of bits already used for encoding macroblocks in that picoire; 

a picmre bit allocation processor coupled to the quantisation step size processor for 
determining said target number of bits allocated for a picmre from a target bit rate and the 
number of bits already used for encoding pictures in a current group of pictures; 

a bit rate adjusmient processor coupled to die picmre bit allocation processor, die 
25 virmal buffer processor and the quantisation step size processor for determining said target 
bit rate from the number of bits already used for encoding successive picmres in die 
current group of picmres, a target encoding quantisation step size and an average 
quantisation step size for picmres in the current group of pictures; and 

a target encoding quantisation step size processor coupled to die bit rate adjusmient 
30 processor and die virmal buffer processor for determining said target encoding 
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quantisation step size from a predetermined target overall bit rate and the number of bits 
used for encoding a preceding group of picwres. 
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